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Abstract 

Using a previously published study of how students differentiate between computing disciplines, this 
study attempts to validate the original research and add additional hypotheses regarding the type of 
institution that the student resides. Using the identical survey instrument from the original study, 
students in smaller colleges and in different cultural contexts are studied. Both the original and the 
validation study consider computing and non-computing majors. Although the original research was 
largely validated through some strikingly similar results, some significant differences were observed 
depending on the size and orientation of the institution. Furthermore, we noted some differences in 
college students outside of the US. 

Keywords: information systems, information technology, computer science, software engineering, 
computer engineering, student perceptions, information systems education 


1. INTRODUCTION 

The January 2010 issue of ACM SIGSOFT 
Software Engineering Notes devoted the 
monthly Software Engineering Education column 
to the topic of how well students differentiate 
between computing disciplines (Ardis & 
Henderson, 2010). The column urged readers to 
obtain and read a study presented at SIGCSE 
2009 (Courte & Bishop-Clark, 2009) that 
surveyed undergraduate students (both 
computing and non-computing majors) to 
determine their understanding of the five major 


computing disciplines: Computer Science (CS), 
Information Technology (IT), Information 
Systems (IS), Computer Engineering (CE), and 
Software Engineering (SE). 

Both articles acknowledged that "there is very 
little difference between majors and non-majors 
in these responses." Furthermore, Ardis & 
Henderson noted that "of the five disciplines 
Software Engineering appears to be the least 
understood." These observations piqued our 
curiosity and led us to engage in several tasks. 
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We wanted to validate this study through our 
own administration of the same survey. We 
contacted the authors of the 2009 SIGCSE study 
and requested a copy of and permission to 
utilize their survey instrument. The request was 
immediately granted and the survey instrument 
provided to us electronically. 

In addition to validating the original study, we 
were particularly interested in hypotheses 
related to the understanding of IS and IT in 
various contexts. Therefore, our sample 
populations vary slightly from the original 
studies in that our student subjects reside in 
different academic and cultural contexts. 

The import of this research lies in our continuing 
efforts to clarify the nature of our discipline so 
as to attract bright individuals. We do this 
because "perception problems carry over to 
computing professionals and educators who, to 
some degree, have difficulty defining, describing 
and explaining these disciplines. This, in turn, 
carries over to prospective students and their 
parents" (Ardis & Henderson, 2010). 
Furthermore, "computer applications are found 
in almost every academic discipline, and the 
creation of useful, innovative computer 
applications in any discipline requires both 
knowledge of that discipline and knowledge of 
computing" (Walker and Kelemen, 2010). 

Therefore, we as educators must continue to 
explore the verbiage and effective 

communication necessary to convey to the world 
outside of our discipline exactly what it is we do 
and why. This survey is a significant part of 
examining and improving that endeavor of 
communicating the essence of our discipline in 
the world of ideas. 

2. SURVEY & HYPOTHESES 

An overview of the original survey from Courte & 
Bishop-Clark, which we used without editing in 
any way to preserve the integrity of our study, is 
presented in Appendix A. We encourage readers 
to read this overview in order to become familiar 
with the verbiage used to differentiate between 
the disciplines in the study. 

In addition to validating the general results 
concerning differentiation between majors and 
non-majors, we were keenly interested in 
discovering if results at our institutions would 
match the original findings. Our institutions fit 
into the small to medium college classification, 
whereas the original study was conducted at 
larger universities. Thus, we wanted to test the 
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hypothesis that students at smaller institutions 
would more accurately differentiate between 
computing disciplines. We also wanted to add 
an international dimension to our study. 
Therefore, we administered the survey to 
students at the American University of 
Afghanistan. Our hypothesis was that students 
at AUAF would less accurately differentiate 
between computing disciplines than their 
American counterparts. We also hypothesized 
that computing majors at both institutions would 
more accurately differentiate between 
computing disciplines than the non-computing 
majors. 

3. RESULTS 

During the spring semester of 2010, students 
were given the survey in Business (non-major) 
and IT, IS, and CS courses at our institutions. 
Many of the original study surveys were 
completed electronically during class time. All of 
our surveys were on paper. 

The original study had 375 students responding. 
The majority (67%) were male. They also had a 
slight majority who were majors (53%). Our 
study had 196 usable respondents completing 
the survey. Some were discarded as unusable 
(e.g., if the student indicated "don't know" for 
every answer). The majority of our American 
respondents were male (68%) and the majority 
of the Afghan respondents (77%) were male. 
We had far fewer majors in our survey (28%) 
than the original. 

The survey asks each respondent three 
questions about each sub-discipline (the order is 
mixed so as to conceal the correct response). 
Thus each survey contains 15 questions in order 
to cover all five sub-disciplines. The questions 
are reproduced in each subsection below. 
Respondents may indicate one of six answers: 
CE, CS, IS, IT, SE, or Don't Know. We will 
contrast the top answers to each question from 
the original study with our study. 

Computer Engineering 

Table 1 shows the results for the CE questions. 
The original study and this validation study 
produced strikingly similar results for the sub¬ 
discipline of Computer Engineering. Each cell 
contains three lines of data - the first indicating 
total students, the second indicating majors and 
the third indicating non-majors. For example, 
the second question, Builds hardware devices 
such as iPods, 82% of majors picked CE in the 
original study, compared to 92% of majors in 
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the US and 56% in Afghanistan. The boldface 
numbers indicate that the percentage is the top 
response and the correct one. The most 
frequently answered sub-discipline is listed in 
the lower portion of cells where the percentage 
is not bolded. For example, majors in the US 
picked CE 15% of the time for Question 3 in 
Table 1 where their top (wrong) answer was CS. 
The actual percentage that picked CS (and other 
wrong answers) is shown in Appendix B. 

Questions 1 and 2 for CE proved to be validated 
in our study. Students are generally aware of 
the fact that Computer Engineers design and 
build hardware. The results are somewhat 
exaggerated in that our US population had much 
stronger results for the majors and the Afghan 
population had weaker results. The third 
question is more interesting in that all three 
populations missed the mark. The top answers 
for all three populations turned out to be 
Computer Science, showing that students are 
universally confused about the fact that 
Computer Engineers more than Computer 
Scientists do a fair amount of hardware/software 
integration. 

Table 1 - Computer Engineering Questions and 
Results (in each cell, the first line indicates total 
students, the second line indicates the majors, 
and the third line indicates non-majors) _ 



Original 

US 

Afghan 

Designs hardware to 

62% 

53% 

38% 

implement 

72% 

82% 

25% 

communications 

systems 

51% 

39% 

41% 

Builds hardware 

71% 

72% 

46% 

devices such as 

82% 

92% 

56% 

iPods 

59% 

61% 

44% 

Integrates computer 

25% 

9% 

14% 

hardware and 

28% 

15% 

13% 

software 

21% 

6% 

14% 


CS 

CS 

CS 


Computer Science 


Table 2 shows the results for the CS questions. 
Once again, the prior study was validated with 
striking consistency. There are some small 
variations within the Afghan survey data which 
will be discussed later. What is striking about 
these results is how consistently students fail to 
differentiate between CS and SE. As Ardis and 
Henderson (2010) have stated, this can "be 


viewed as a perception problem for all students 
regarding software engineering." 

Table 2 - Computer Science Questions (total 


students, majors, and non-maj 

ors) 


Original 

US 

Afghan 

Uses new theories to 

33% 

18% 

14% 

create cutting edge 

40% 

21% 

13% 

software 

26% 

17% 

14% 


SE 

SE 

SE 

Focuses on the 

51% 

57% 

25% 

theoretical aspects 

56% 

62% 

31% 

of technology 

46% 

55% 

23% 




IS 

Utilizes theory to 

36% 

25% 

14% 

research and design 

40% 

41% 

13% 

software solutions 

31% 

17% 

14% 


SE 

SE 

SE 


We do not believe that these results can be 
totally attributed to perception confusion 
between CS and SE. The reader will notice that 
both questions 1 and 3 in Table 2 feature the 
word "software" prominently. One wonders how 
the results would have differed by substituting 
the phrase "computing system" for "software" in 
these questions, which would shift the emphasis 
to theory. 

Software Engineering 

Table 3 shows the results for the SE questions. 
We have placed the SE and CS sections together 
since they really tell the same story as the 
results show. Students are not able to identify 
the statements in this survey as pertaining to 
SE. The only exception to this being that US 
students in our study were able to correctly 
choose SE related to "testing large scale 
systems." Again, one wonders how the wording 
of the survey questions might impact the 
outcomes. Clearly the word "software" 
substituted for "technological" or "systems" 
could change the results even though the 
emphasis of this line of questioning is on "large 
scale." In most cases it appears that students 
make their selection based on certain key words. 
We can't help but notice that the word "system" 
occurs in questions 1 and 2 in Table 3, which 
apparently leads students to choose IS as their 
answer. 
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Table 3 - Software Engineering Questions (total 


students, majors, and non-mai 

ors) 


Original 

US 

Afghan 

Focuses on large- 

12% 

13% 

4% 

scale systems 

17% 

18% 

6% 

development 

6% 

10% 

3% 


IS 

IS 

IS 

Designs testing 

23% 

22% 

18% 

procedures for large- 

27% 

36% 

19% 

scale systems 

18% 

14% 

17% 


IS 


IS 

Manages large scale 

10% 

7% 

13% 

technological 

13% 

18% 

13% 

projects 

6% 

1% 

13% 


IS 

CE 

IT 


Information Systems 

Table 4 shows the results for the IS questions. 
Notice that the US students in our survey 
outperformed the original survey students by 
about 10 points in each category. The Afghan 
students on the other hand were more torn 
between IS and IT when it came to identifying 
the "business" orientation of IS. We will discuss 
potential reasons for this below. 

Table 4 - Information Systems Questions (total 


students, majors, and non-mai 

ors) 


Original 

US 

Afghan 

Is business oriented 

51% 

59% 

29% 


59% 

69% 

31% 


42% 

53% 

28% 




IT 

Combines knowledge 

40% 

51% 

26% 

of business and 

48% 

59% 

25% 

technology 

31% 

47% 

27% 




IT 

Selects computer 

43% 

47% 

28% 

systems to improve 

49% 

54% 

38% 

business processes 

37% 

44% 

25% 


Information Technology 

Table 5 shows the results for the IT questions. 
The results show that the US students in our 
survey performed comparably to the original in 
questions 1 and 3, but were more prone to see 
question 2 as pertaining to CS. The Afghan 
student responses were mixed between IT, IS 
and CE (the CE responses pertaining particularly 
to question 3). 


Table 5 - Information Technology Questions 
(total students, majors, and non-majors) _ 



Original 

US 

Afghan 

Troubleshoots and 

32% 

35% 

23% 

designs practical 

36% 

38% 

44% 

technical 

applications 

27% 

32% 

17% 

Applies technology 

35% 

24% 

31% 

to solve practical 

40% 

15% 

38% 

problems 

30% 

29% 

30% 



CS 


Applies technical 

55% 

53% 

15% 

knowledge for 

67% 

72% 

31% 

product support 

41% 

43% 

11% 


4. CONCLUSIONS 

Our first hypothesis was that students at smaller 
liberal arts based institutions would more 
accurately differentiate between computing 
disciplines. The rationale for this hypothesis is 
that our smaller institutions emphasize the 
liberal arts and as such tend to discuss the 
points of commonality and difference between 
disciplines (not just limited to computing 
disciplines). As noted by Walker and Kelemen 
(2010), "Overall, a liberal arts program 
emphasizes general knowledge, multiple 
perspectives, alternative ways of thinking, and 
connections among disciplines." This hypothesis 
proved to be true among the US computing 
majors who out performed the students from the 
original study in 12 out of 15 questions. The 
non-majors, however, only outperformed the 
subjects in the original study in 8 out of 15 
questions. 

Our second hypothesis was that students at 
AUAF would underperform the American 
students. Our rationale being that the 
computing educational infrastructure in 
Afghanistan is very new. This hypothesis 
appears to be substantiated by the data in that 
both majors and non-majors in our study only 
outperformed the original study in 1 out of 15 
questions. We should mention here that our 
study in Afghanistan only included 16 majors of 
the 80 total surveys from AUAF. Additionally, out 
of these 16 majors, 8 were freshman, 6 were 
sophomores and only 2 were juniors. AUAF is a 
still in its infancy with no student in the senior 
year of a computing major. 

We would be remiss if we did not point out a 
particular bias of the Afghan students in this 
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study. The majors at AUAF are in a program 
that is a hybrid of IS, IT and CS. Many of the 
students work full or part-time as IT/IS 
employees with local firms in Kabul. However, 
they have communicated to the administration 
on several occasions that they wish to have the 
department called "computer science" since they 
perceive that the most prestigious institutions in 
the US have computer science programs. This 
desire to be called computer science may 
significantly influence the students' ability to 
differentiate between the computing disciplines. 

Our third hypothesis was that majors would 
more accurately differentiate between 
computing disciplines than non-majors. 
Kurkovsky (2007) discussed and suggested a 
need to clear misconceptions among the non¬ 
majors about CS. Our study confirms not only 
the initial finding of misconceptions about CS 
among non-majors but about all computing 
disciplines in general. In the original study, the 
majors outperformed the non-majors in all 15 
questions. The US majors in our study 
outperformed the non-majors in 14 out of 15 
questions (the one exception being the 2 nd IT 
question). The Afghan majors in our study 
outperformed the non-majors in 9 out of 15 
questions. Thus, in the US population, we can 
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confidently assert that our original hypothesis 
was correct, especially given that in many 
instances the difference was in excess of 20 
percentage points. However, the outcomes in 
the Afghan population were more mixed. What 
impact (at AUAF) does having the majority of 
computing major students (88%) in their initial 
years of studies? This may be an area of further 
research. 
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Appendix A 


Overview of the original survey by Courte & Bishop-Clark (2009): 

Respondents were presented with phrases descriptive of each discipline and asked to select one 
discipline that they thought best matched the phrase (options included Computer Engineering, 
Computer Science, Information Science, Information Technology, Software Engineering, and Don't 
know). There were 15 phrases with 3 for each discipline, randomly mixed. The phrases were created 
by surveying colleagues and other practitioners for keywords thought to represent the discipline. 
Keywords that had a greater consensus were then used to construct the survey phrases. 

For Computer Engineering, the keyword was hardware : 

• Designs hardware to implement communications systems 

• Builds hardware devices such as iPods 

• Integrates computer hardware and software 

For Computer Science, the keyword was theory 

• Uses new theories to create cutting edge software 

• Focuses on the theoretical aspects of technology 

• Utilizes theory to research and design software solutions 

For Information Science, the keyword was business : 

• Is business oriented 

• Combines knowledge of business and technology 

• Selects computer systems to improve business processes 

For Information Technology, the keywords were practical and applied: 

• Troubleshoots and designs practical technical applications 

• Applies technology to solve practical problems 

• Applies technical knowledge for product support 

For Software Engineering, the keywords were large-scale systems and projects : 

• Focuses on large-scale systems development 

• Designs testing procedures for large-scale systems 

• Manages large scale technological projects 

Respondents were also asked to provide basic demographic information, such as gender, age, 
state and type of employment, student status, major, and type of university. 
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Appendix B - Computer Engineering 


100 . 00 % 

80.00% 

60.00% 

40.00% 

20 . 00 % 

0 . 00 % 



Designs hardware to implement 
communications systems 


SMCVT-CE 

■ AUAF-CE 
SMCVT - CS 
SMCVT- IS 

■ SMCVT - IT 

■ SMCVT-SE 

■ SMCVT - Don't Know 
AUAF-CS 

AUAF- IS 

■ AUAF - IT 
■ AUAF-SE 

■ AUAF - Don't Know 



Integrates computer hardware and software 


■ SMCVT-CE 

■ AUAF-CE 
SMCVT-CS 
SMCVT - IS 

■ SMCVT - IT 

■ SMCVT-SE 

■ SMCVT - Don't Know 
AUAF-CS 

AUAF - IS 
AUAF - IT 

■ AUAF-SE 

■ AUAF - Don't Know 


100 . 00 % 

90.00% 

80.00% 

70.00% 

60.00% 

50.00% 

40.00% 

30.00% 

20 . 00 % 

10 . 00 % 

0 . 00 % 



Builds hardware devices such as iPods 


■ SMCVT-CE 

■ AUAF-CE 
SMCVT - CS 
SMCVT - IS 

■ SMCVT - IT 

■ SMCVT -SE 

■ SMCVT - Don't Know 
AUAF-CS 

AUAF - IS 

■ AUAF - IT 
■ AUAF-SE 

■ AUAF - Don't Know 
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Computer Science 



Uses new theories to create cutting edge software 


■ SMCVT-CS 

■ AUAF-CS 
SMCVT-CE 
SMCVT- IS 

■ SMCVT - IT 

■ SMCVT-SE 

■ SMCVT - Don't Know 
AUAF-CE 

AUAF- IS 

■ AUAF- IT 
■ AUAF-SE 

■ AUAF - Don't Know 


100 . 00 % 

90.00% 

80.00% 

70.00% 

60.00% 

50.00% 

40.00% 

30.00% 

20 . 00 % 

10 . 00 % 

0 . 00 % 



Focuses on the theoratical aspects of 
technology 


■ SMCVT-CS 

■ AUAF-CS 
SMCVT-CE 

■ SMCVT - IS 

■ SMCVT - IT 

■ SMCVT -SE 

■ SMCVT - Don't Know 
AUAF-CE 

■ AUAF-IS 
AUAF - IT 

■ AUAF-SE 

■ AUAF - Don't Know 


100 . 00 % 

90.00% 

80.00% 

70.00% 

60.00% 

50.00% 

40.00% 

30.00% 

20 . 00 % 

10 . 00 % 

0 . 00 % 



Utilizes theory to research and design software 
solutions 


■ SMCVT-CS 

■ AUAF-CS 
SMCVT-CE 
SMCVT - IS 

■ SMCVT - IT 

■ SMCVT-SE 

■ SMCVT - Don't Know 
AUAF-CE 

AUAF - IS 
AUAF - IT 
■ AUAF-SE 

■ AUAF - Don't Know 
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Software Engineering 


100 . 00 % 

90.00% 

80.00% 

70.00% 

60.00% 

50.00% 

40.00% 

30.00% 

20 . 00 % 

10 . 00 % 

0 . 00 % 



Focuses on large-scale systems development 


■ SMCVT-SE 

■ AUAF-SE 
SMCVT-CE 

■ SMCVT-CS 

■ SMCVT - IS 

■ SMCVT - IT 

■ SMCVT - Don't Know 
AUAF-CE 

■ AUAF-CS 

■ AUAF- IS 

■ AUAF- IT 

■ AUAF - Don't Know 


100 . 00 % 

90.00% 

80.00% 

70.00% 

60.00% 

50.00% 

40.00% 

30.00% 

20 . 00 % 

10 . 00 % 

0 . 00 % 





Designs testing procedures for large-scale 
systems 


SMCVT - SE 

■ AUAF-SE 
SMCVT - CE 
SMCVT - CS 

■ SMCVT - IS 

■ SMCVT - IT 

■ SMCVT - Don't Know 
AUAF-CE 
AUAF-CS 

AUAF - IS 

■ AUAF-IT 

■ AUAF - Don't Know 


100 . 00 % 

90.00% 

80.00% 

70.00% 

60.00% 

50.00% 

40.00% 

30.00% 

20 . 00 % 

10 . 00 % 

0 . 00 % 


Manages large scale technological projects 



■ SMCVT-SE 

■ AUAF-SE 
SMCVT-CE 

■ SMCVT-CS 

■ SMCVT - IS 

■ SMCVT - IT 

■ SMCVT - Don't Know 
AUAF-CE 

AUAF-CS 
AUAF - IS 

■ AUAF - IT 

■ AUAF - Don't Know 
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Information Systems 


100 . 00 % 

90.00% 

80.00% 

70.00% 

60.00% 

50.00% 

40.00% 

30.00% 

20 . 00 % 

10 . 00 % 

0 . 00 % 



Is business oriented 


■ SMCVT - IS 

■ AUAF- IS 
SMCVT-CE 

■ SMCVT-CS 

■ SMCVT - IT 

■ SMCVT -SE 

■ SMCVT - Don't Know 
AUAF-CE 

AUAF-CS 

■ AUAF - IT 
■ AUAF-SE 

■ AUAF - Don't Know 


100 . 00 % 

90.00% 

80.00% 

70.00% 

60.00% 

50.00% 

40.00% 

30.00% 

20 . 00 % 

10 . 00 % 

0 . 00 % 



Selects computer systems to improve business processes 


SMCVT - IS 

■ AUAF-IS 
SMCVT-CE 
SMCVT-CS 

■ SMCVT - IT 

■ SMCVT-SE 

■ SMCVT - Don't Know 
AUAF-CE 

AUAF-CS 
AUAF - IT 
■ AUAF-SE 

■ AUAF - Don't Know 


100 . 00 % 

90.00% 

80.00% 

70.00% 

60.00% 

50.00% 

40.00% 

30.00% 

20 . 00 % 

10 . 00 % 

0 . 00 % 



Combines knowledge of business and technology 


H SMCVT - IS 

■ AUAF - IS 
SMCVT-CE 

■ SMCVT-CS 

■ SMCVT - IT 

■ SMCVT -SE 

■ SMCVT - Don't Know 
AUAF-CE 

AUAF-CS 
H AUAF - IT 
■ AUAF-SE 

■ AUAF - Don't Know 
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Information Technology 



Troubleshoots and designs practical technical 
applications 


■ SMCVT - IT 

■ AUAF- IT 
SMCVT-CE 
SMCVT-CS 

■ SMCVT - IS 

■ SMCVT-SE 

■ SMCVT - Don't Know 
AUAF-CE 

AUAF-CS 
AUAF - IS 
■ AUAF-SE 

■ AUAF - Don't Know 



Applies technical knowledge for product support 


■ SMCVT - IT 

■ AUAF - IT 
SMCVT-CE 
SMCVT-CS 

■ SMCVT - IS 

■ SMCVT -SE 

■ SMCVT - Don't Know 
AUAF-CE 

AUAF-CS 
9 AUAF - IS 
■ AUAF-SE 

■ AUAF - Don't Know 


100 . 00 % 

90.00% 

80.00% 

70.00% 

60.00% 

50.00% 

40.00% 

30.00% 

20 . 00 % 

10 . 00 % 

0 . 00 % 



Applies technology to solve practical problems 


■ SMCVT - IT 

■ AUAF - IT 
SMCVT-CE 

■ SMCVT-CS 

■ SMCVT - IS 

■ SMCVT -SE 

■ SMCVT - Don't Know 
AUAF-CE 

AUAF-CS 

■ AUAF - IS 

■ AUAF-SE 

■ AUAF - Don't Know 
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